Driving Behavior Modeling Using Naturalistic Human Driving Data With Inverse Reinforcement Learning
نویسندگان
چکیده
Driving behavior modeling is of great importance for designing safe, smart, and personalized autonomous driving systems. In this paper, an internal reward function-based model that emulates the human’s decision-making mechanism utilized. To infer function parameters from naturalistic human data, we propose a structural assumption about focuses on discrete latent intentions. It converts continuous problem to setting thus makes maximum entropy inverse reinforcement learning (IRL) tractable learn functions. Specifically, polynomial trajectory sampler adopted generate candidate trajectories considering high-level intentions approximate partition in IRL framework. An environment interactive behaviors among ego surrounding vehicles built better estimate generated trajectories. The proposed method applied functions individual drivers NGSIM highway dataset. qualitative results demonstrate learned are able explicitly express preferences different interpret their decisions. quantitative reveal robust, which manifested by only marginal decline proximity when applying testing conditions. For performance, outperforms general approach, significantly reducing errors likeness (a custom metric gauge accuracy), these two methods deliver compared other baseline methods. Moreover, it found predicting response actions incorporating potential decelerations caused vehicle critical estimating trajectories, accuracy planning using relies forecasting model.
منابع مشابه
Fast Inverse Reinforcement Learning with Interval Consistent Graph for Driving Behavior Prediction
Maximum entropy inverse reinforcement learning (MaxEnt IRL) is an effective approach for learning the underlying rewards of demonstrated human behavior, while it is intractable in high-dimensional state space due to the exponential growth of calculation cost. In recent years, a few works on approximating MaxEnt IRL in large state spaces by graphs provide successful results, however, types of st...
متن کاملVariations on a theme: Topic modeling of naturalistic driving data.
This paper introduces Probabilistic Topic Modeling (PTM) as a promising approach to naturalistic driving data analyses. Naturalistic driving data present an unprecedented opportunity to understand driver behavior. Novel strategies are needed to achieve a more complete picture of these datasets than is provided by the local event-based analytic strategy that currently dominates the field. PTM is...
متن کاملIntegrated Driving Behavior Modeling
A framework for integrated driving behavior modeling, based on the concepts of short-term goal and short-term plan is proposed. Drivers are assumed to conceive and perform short-term plans in order to accomplish short-term goals. This behavioral framework captures drivers' planning capabilities and allows decisions to be based on anticipated future conditions. An integrated driving behavior mod...
متن کاملClustering of Naturalistic Driving Encounters Using Unsupervised Learning
Deep understanding of driving encounters could help self-driving cars make appropriate decisions when driving in complex settings with surrounding vehicles engaged. This paper develops an unsupervised classifier to group naturalistic driving encounters into several distinguishable clusters by combining an auto-encoder with a k-means clustering (AE-kMC). In order to show the effectiveness of our...
متن کاملFueling Alternatives: Evidence from Naturalistic Driving Data
We use naturalistic driving data to analyze the refueling behavior of drivers. The data come from a year-long study in which drivers were provided with experimental vehicles to use for seven weeks. We use data logged during the experiment to identify the time and location of refueling stops. With this dataset, we estimate a discrete choice model for the driver’s choice of refueling location. We...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Intelligent Transportation Systems
سال: 2022
ISSN: ['1558-0016', '1524-9050']
DOI: https://doi.org/10.1109/tits.2021.3088935